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Abstract 


We  present  a  modulation  technique  to  embed  a  binary  bitstream  within  a  real- valued 
Gaussian  noise  sequence.  The  modulation  produces  a  sequence  which  possesses  an 
optimal  minimum  distance  property  that  promotes  accurate  detection  when  the  sequence 
has  been  exposed  to  noise.  Because  the  modulated  sequence  possesses  Gaussian 
properties  and  has  low  power,  it  is  difficult  for  unintended  parties  to  intercept  and  detect 
the  signal.  The  technique  can  be  used  to  hide  information  in  a  signal  that  is  then  added  to 
a  carrier  for  a  variety  of  applications. 
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1.  Introduction 


In  many  applications,  the  capability  to  conceal  the  transmission  of  information  is  desired. 
Such  is  the  case  for  applications  of  steganography,  watermarking,  and  tamperproofing.  An 
effective  method  of  concealing  information  is  to  exploit  the  properties  of  existing  systems; 
there  are  numerous  techniques  currently  in  existence  [1,  2,  3]. 

For  example,  various  types  of  noise  exist  in  the  output  of  many  electronic  systems,  natural 
digital  images,  and  audio  signals.  We  can  take  advantage  of  this  phenomenon  by  concealing 
or  embedding  information  in  a  noise  signal.  This  signal  can  then  be  added  to  or  used  as 
a  replacement  for  the  inherent  noise  in  the  system.  If  this  embedded  signal  maintains  the 
characteristics  of  the  inherent  noise,  it  will  be  difficult,  if  not  impossible,  to  distinguish  the 
signal  from  the  carrier’s  innate  noise. 

From  Shannon’s  information  theory,  we  know  that  in  the  presence  of  interference  and 
jamming,  a  communicator’s  best  waveform  should  statistically  appear  as  Gaussian  noise  [4, 
5].  This  is  true  because  maximum  entropy  is  obtained  from  Gaussian  statistics  due  to  the 
wideband  spectral  properties  of  the  waveform. 

We  apply  Shannon’s  recommendation  during  the  development  of  the  Piecewise  Linear 
Noise  Modulation  (PLNM)  scheme  by  requiring  that  the  modulated  output  produce  a  se¬ 
quence  that  appears  as  Gaussian  noise,  regardless  of  the  value  of  the  data  signal.  This 
Gaussian  noise  signal  may  then  be  added  to  a  carrier  of  some  type  to  transmit  the  embed¬ 
ded  information.  Furthermore,  because  interference  caused  by  the  transmission  channel  or 
imperfect  carrier  recovery  may  lead  to  problematic  detection  of  the  embedded  data  signal, 
a  minimum  Euclidean  distance  property  among  the  modulated  values  is  desired. 

PLNM  embeds  binary  information  within  a  real-valued  Gaussian  noise  sequence.  The 
PLNM  output  maintains  a  minimum  Euclidean  distance,  proportional  to  the  power  of  the 
embedded  signal,  to  allay  the  effects  of  distortion  on  the  demodulated  signal.  The  carrier  re¬ 
quirements  for  our  system  are  very  flexible.  In  general,  the  embedded  waveform  can  be  added 
to  any  signal  that  is  typically  exposed  to  noise  that  is  modelled  as  white  Gaussian  noise.  The 
PLNM  technique  yields  good  performance  and  was  employed  in  the  steganographic  system 
presented  by  Marvel  et  al.  [2]. 

In  the  following  section,  we  present  background  and  motivation  for  our  noise  modulation 
technique  by  citing  the  parallels  and  distinctions  between  PLNM  and  traditional  spread 
spectrum  communication.  We  then  describe  a  simple  antipodal  noise  modulation  technique 
and  its  problematic  detection  in  section  3.  Then  in  section  4,  we  present  the  PLNM  scheme 
along  with  its  mathematical  foundation.  Next  we  use  the  information  presented  thus  far  to 
compare  the  two  noise  modulation  techniques  in  section  5.  Finally,  in  section  6  we  draw 
conclusions  and  present  directions  for  future  research. 
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2.  Background 


Although  both  PLNM  and  traditional  spread  spectrum  communication  techniques  have 
similar  communication  objectives,  there  are  obvious  contrasts  between  the  two.  Both  meth¬ 
ods  can  be  used  to  generate  a  signal  that  has  low  power,  a  robustness  to  interference,  and 
is  difficult  to  detect.  The  spread  spectrum  signal  is  generated  by  modulating  a  data  signal 
onto  a  wideband  carrier  so  that  the  resultant  transmitted  signal  has  a  much  larger  band¬ 
width  than  the  original  bandwidth  of  the  data  and  is  relatively  insensitive  to  the  value  of  the 
data  signal  [6].  PLNM  operates  in  a  analogous  manner  by  embedding  a  binary  data  signal 
within  a  wideband  Gaussian  noise  sequence.  Both  systems  are  typically  capable  of  operating 
at  low  power,  thereby  providing  a  signal  that  is  difficult  to  detect  and  that  possesses  the 
interference  immunity  of  a  wideband  waveform.  Furthermore,  PLNM  relies  on  the  concept 
of  a  stored-reference  spread  spectrum  [7],  where  an  identical  key  and  pseudorandom  number 
generator  are  necessary  at  the  transmitter  and  receiver. 

In  a  traditional  spread  spectrum  system,  the  wideband  signal  is  obtained  by  modulating 
the  data  signal  with  a  spread  spectrum  code  generator  and  then  an  RF  oscillator  via  fre¬ 
quency  or  phase  modulation.  In  contrast,  PLNM  is  an  amplitude  modulation  scheme  that 
generates  a  real- valued  noise  sequence  that  can  replace  or  be  added  to  inherent  noise  in  a  sys¬ 
tem.  The  selection  of  this  system  is  arbitrary:  for  example,  a  digital  image  or  audio  sequence 
can  function  as  a  carrier.  Detection  issues  related  to  signal  recovery  in  spread  spectrum  are 
addressed  by  adding  redundancy  with  the  binary  spread  spectrum  code  and  applying  car¬ 
rier  recovery  techniques.  PLNM  provides  improved  detection  performance  by  providing  a 
minimum  distance  property  that  is  proportional  to  the  noise  signal  power.  Additional  error 
protection  may  be  obtained  by  encoding  the  data  signal  via  an  error  control  code  whose 
rate  depends  on  anticipated  carrier  recovery  performance  and  channel  noise.  Furthermore, 
since  the  PLNM  noise  signal  is  added  to  the  carrier  (typically  an  image  or  audio  sequence), 
carrier  acquisition  may  be  performed  using  a  variety  of  noise  removal  filters.  The  challenge 
of  synchronization  is  trival  because  it  is  addressed  by  the  synchronization  of  the  carrier  of 
its  format  (e.g.,  image,  audio,  video,  etc.). 


3*  Simple  Antipodal  Noise  Modulation 


Let  us  begin  by  describing  an  antipodal  noise  modulation  technique,  similar  to  the  one 
used  by  Hartung  and  Girod  [3].  Assume  that  the  message  signal  m  is  a  bilevel  signal 
consisting  of  symbols  from  {—!,+!},  and  the  noise  sequence  n  €  3?  is  generated  by  a 
pseudorandom  number  generator  emulating  a  Gaussian  distribution  with  zero  mean  and 
variance,  a2  *.  The  value  of  a2  can  be  adjusted  to  provide  a  desired  amount  of  robustness, 
but  is  limited  by  the  susceptibility  of  detection  (in  the  sense  of  low  probability  of  detection). 

In  what  follows,  we  will  adopt  the  notation  iV(//,cr2)  to  represent  the  Gaussian  distribution  with  mean 
p  and  variance  cr . 
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The  two  signals  are  modulated  by  simple  multiplication, 

s(n,-,  m,)  =  rii  *  m,-.  (1) 

The  modulated  signal,  s  €  3£,  is  a  sequence  possessing  a  Gaussian  distribution  with  zero 
mean  and  variance  a1.  The  signs  of  the  message  bit  and  the  noise  sequence  determine  the 
sign  of  the  modulated  signal.  Since  the  noise  sequence  is  symmetric  about  zero,  a  change  in 
sign  preserves  the  Gaussian  distribution  of  the  signal  [8]. 

The  demodulation  process  is  straightforward.  The  sequence  n  is  replicated  at  the  receiver, 
and  the  sign  of  each  symbol  of  this  sequence  is  compared  to  the  sign  of  the  corresponding 
symbol  in  the  received  modulated  sequence,  £,  to  recover  an  estimated  value  of  the  message 
sequence,  m,  as  follows: 


(2) 


Even  though  this  modulation  method  meets  the  necessary  requirements  of  producing  a 
Gaussian  sequence,  regardless  of  the  distribution  of  the  message  sequence,  a  major  deficiency 
lies  with  detecting  this  signal.  Because  the  modulated  signal  must  follow  a  Gaussian  dis¬ 
tribution,  most  of  the  sample  values  occur  in  the  vicinity  of  zero,  with  fewer  values  in  the 
tails.  Moreover,  only  the  variation  of  the  sign  of  the  received  signal  indicates  the  value  of  the 
encoded  message  bits.  Although  the  distance  between  the  values  of  the  modulated  signal  for 
both  values  of  m, 


D  =  | s(n,-,m4  =  -1)  -  s(rn,mi  =  +1)|  =  2|n,|,  (3) 

is  large  for  extreme  values  of  the  waveform,  it  is  much  more  often  small,  in  accordance  with 
the  Gaussian  distribution. 

In  most  instances,  when  the  modulated  signal  is  exposed  to  external  noise  from  the  effects 
of  the  carrier  or  the  transmission  channel,  correct  detection  of  the  encoded  message  sequence 
is  problematic.  As  with  many  communication  signals  that  may  be  exposed  to  noise,  we  want 
the  points  within  our  signal  constellation  as  far  apart  as  possible,  reflecting  a  large  minimum 
distance. 

This  minimum  distance  is  defined  as  the  smallest  Euclidean  distance  between  all  pairs  of 
distinct  points  in  the  signal  constellation, 

dmin  =  min  |s(n,-,  m4  =  -1)  —  s(n4,m4-  =  +1)|  =  min2|n4|  =  2min|n4|.  (4) 

i  i  i 

Communication  constellations  are  typically  compared  by  their  dmin  ■  If  the  modulated  signal 
incurs  noise  or  distortion,  the  larger  the  minimum  distance,  the  more  distortion  the  modu¬ 
lated  signal  can  incur  and  still  be  demodulated  correctly.  However,  if  the  distortion  is  greater 
than  the  threshold  value  dmuij2.  then  a  demodulation  error  will  occur. 

With  this  simple  system,  dmin  =  0.  To  improve  detection  performance,  it  is  desirable 
for  minimum  distance  to  be  as  large  as  possible.  This  will  promote  reliable  recovery  of  the 
estimate  of  i. 
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4.  Piecewise  Linear  Noise  Modulation  (PLNM)  Scheme 

Under  the  constraint  that  the  modulated  signal  maintain  a  Gaussian  distribution,  an 
improved  modulation  technique  should  modulate  keyed  pseudorandom  values  with  the  bilevel 
message  bits  and  produce  a  sequence  of  real  numbers  that  follow  a  Gaussian  distribution 
and  yield  a  large  minimum  distance. 

Formally,  if  xu  x2, . . .  represents  a  random  sequence  from  a  Gaussian  distribution,  N( 0,  a2), 
we  want  to  determine  a  transformation  t*  such  that  f*(xi),r(x2), . . .  is  also  distributed 
Ar(0,  or2)  and  satisfies  the  expression 

maxmin|x,-i(xi)|,  (5) 

where  f)  is  the  set  of  all  transformations  of  JV(0,  a2)  onto  itself. 

To  aid  in  the  delineation  of  fi,  we  will  appeal  to  the  relationship  between  a  continuous 
distribution  and  the  uniform  distribution  on  the  unit  interval  [9].  Simply  stated,  for  any 
continuous  random  variable  x,  with  distribution  /(x)  and  cumulative  distribution  function 
(cdf)  F(x),  F(x)  transforms  the  variate  x  into  a  variate  distributed  uniformly  on  the  unit, 
interval.  Symbolically,  .F(x)  ~  17(0,1),  where  the  notation  denotes  u  distributed”  and 
17(0, 1)  the  uniform  distribution  on  the  unit  interval.  Conversely,  the  inverse  mapping  JF1-1(u) 
maps  a  uniform  variate  into  a  variate  having  distribution  f(x). 

This  means  that  V  t  G  ft,  the  transformation  t :  N(0,a2)  — ►  Ar(0,  a2)  can  be  expressed  as 

t(x)  =  $_1(s($(*))),  (6) 

where  $(■)  denotes  the  Gaussian  cdf,  and  the  function  g(-)  is  a  mapping  of  the  unit  interval 
onto  itself.  Expressing  t(x)  as  a  composite  function  facilitates  our  inquiry  since  (i)  it  estab¬ 
lishes  that  V  t  €  ft  3  a  unique  bijection  g  of  the  unit  interval,  and  it  emphasizes  that  (ii)  the 
bijection  g  must  also  be  distribution  preserving.  It  is  therefore  sufficient  to  limit  our  search 
for  t"  to  consideration  of  the  set  of  all  mappings  of  17(0, 1)  onto  itself. 

Consider  the  transformation  that  produces  the  modulation  points  for  the  antipodal  mod¬ 
ulation  method  presented  in  Section  3.  Let  ui,u2, . . .  be  a  random  sequence  from  17(0, 1). 
The  transform 


g(u)  =  1  —  u  0  <  u  <  1,  (7) 

shown  in  Figure  1,  yields  g(u i),^(u2),  •  •  •  from  which  the  modulated  signal  of  the  antipodal 
modulation  system  can  be  constructed  as 


$-1(u) 


m  =  - f  1 
m  =  — 1. 


(8) 


For  u  —  j,  g{u)  —  u,  and  the  distance  (3)  is  zero.  In  this  instance,  the  message  bit  m,  cannot 
be  recovered,  even  in  the  absence  of  noise. 
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Figure  1.  Transformation  for  Antipodal  Noise  Modulation 


Now  consider,  as  the  basis  for  PLNM,  the  following  transformation: 

(  u  +  \  0<u<! 

g(u)  =lu-\\<u<l  (9) 

[  0  otherwise. 

As  can  be  seen  in  Figure  2,  g(u )  is  piecewise  linear  with  a  single  discontinuity  at  u  = 


Figure  2.  Transformation  for  PLNM 

To  encode,  each  element  of  the  modulated  signal  sequence  s  is  formed  by  selecting  from  u 
or  g(u ),  arbitrated  by  the  elements  of  the  message  signal,  m,  and  transformed  to  a  Gaussian 
random  value,  as  prescribed  in  (8). 

Demodulation  of  the  modulated  sequence  is  accomplished  by  first  regenerating  both 
$_1(u)  and  $-1  ((/(«))  at  the  receiver  and  calculating  a  threshold  as  the  midpoint.  The 
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estimated  modulated  signal  is  then  compared  to  this  threshold  to  determine  the  estimated 
value  of  the  encoded  message. 

4.1  Mathematical  Foundation 

In  this  section  we  focus  on  relation  (9)  in  the  search  for  a  transformation  t*  that  max¬ 
imizes  the  minimum  distance  between  the  two  possible  modulated  values  as  expressed  in 
(5).  We  first  establish  that  g(u )  in  (9)  preserves  the  uniform  distribution  requirement.  This 
condition  is  necessary  to  assure  that  when  the  inverse  Gaussian  cdf,  is  applied,  the 

inverse  value  will  follow  a  Gaussian  distribution.  Then  we  show  that  the  transform  (9)  is 
optimal  in  maximizing  the  minimum  distance  between  u  and  g(u).  We  then  proceed  to 
quantify  the  minimum  distance  between  $-1(u)  and  $_1(0(u)).  Finally,  we  embed  g(u)  into 
a  more  general  result  characterizing  the  family  of  piecewise  linear  transformations  of  the 
type  considered  here. 

4.1.1  Distribution  of  the  Transformed  Variable 

We  establish  that  g(u )  ~  U ( 0 . 1)  by  showing  that  its  moment  generating  function  coin¬ 
cides  with  that  of  the  uniform  distribution. 

If  f(x)  is  the  probability  distribution  function  of  a  random  variable  X ,  the  moment 
generating  function  of  g(X)  is  defined  [10]  as 

Mg(x) (t)  -  f  eta^f(x)dx.  (10) 

'  J— OO 

Now,  let  u  ~  17(0, 1)  and  let 

’  it  +  |  0<u<| 

g(u)=  l  u-\  |<u<  1  (11) 

0  otherwise. 

Then,  the  moment  generating  function  for  g(U)  is 

Mg(u)(t)  =  r  e^f(u)du 

J  —  CO 

=  JJ  e^Uu  +  e^Uu  (12) 

=  -  !)■  (13) 

The  Uniqueness  Theorem  [11]  asserts  the  following:  Let  X  and  Y  be  two  random  variables 
with  moment  generating  functions  Mx{t)  and  My{t),  respectively.  If  Mx(t)  =  My(t)  for  all 
values  of  t,  then  X  and  Y  have  the  same  probability  distribution. 

Since  Mg(u}(t)  —  l(e*  —  1)  =  —  the  moment  generating  function  for  a  17(0, 1) 

variate  [12]  —  the  result  is  established. 
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4.1.2  Optimality  Condition 


Let  T  =  { fi}iel  denote  the  class  of  bijections  of  the  unit  interval  indexed  over  the  set  I. 
For  the  value  x  =  the  inequality 


1*  - /(*)l  =  |i  - /(j)l  <  5 

(14) 

holds  V  ft  €  therefore, 

max  min  lx  —  /(x)|  <  — . 

(15) 

Consider  the  transformation  (11).  Since 

l«-5(«)l  =  |  Vu  €  [0,1], 

(16) 

we  have 

min  1  u  — 

tt€[0,l]'  *v  71  2 

(17) 

but  g  €  T,  therefore  g(u)  satisfies  condition  (15). 

This  establishes  that  the  piecewise  linear  function  (11)  is  an  optimal  transformation  on 
the  unit  interval,  in  that  the  upper  bound,  ^  in  inequality  (15),  is  everywhere  assumed. 


4.1.3  Minimum  Euclidean  Distance 

We  begin  by  expressing  the  distance  between  the  possible  modulation  values  of  our  piece- 
wise  linear  transformation  as 


D  =  |*-'(«)  -  *-1(<?(«))|  •  (18) 

To  find  the  maximum  or  minimum  of  a  differentiable  function,  we  would  investigate  the 
points  at  which  the  derivative  is  equal  to  0.  However,  the  inverse  Gaussian  cdf,  $_1,  does 
not  exist  in  closed  form,  so  we  are  denied  a  direct  approach  to  determine  the  minimum  value 
of  the  distance  D. 

Now  consider  the  signed  difference: 

(ir^-ar^  +  i),  o <«<|.  (19) 

By  definition,  the  uth  percentile  of  a  normal  variate,  xu,  satisfies  the  following  relations: 

$(xu)  =  f  <f>(t)dt  =  u;  $~1(u)  =  xu,  0<u<l  (20) 

J  — OO 

where  $'(•)  =  ^(-),  the  normal  distribution  function. 
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(21) 


On  the  interval  0  <  u  <  we  have 


$  1(g(U))  =  $  J(u)  -  <J>-1(u  -I-  I)  =  _  X(u+±y 

Consider  now  the  subinterval  0  <  u  <  \  and  an  arbitrarily  small  e  >  0  such  that 

u  +  e  €  (0,  i)  and  g(u  +  e)  =  u  +  |  +  e  €  (|,  |).  (22) 

For  every  e  >  0  satisfying  (22)  3  8  =  <5(u,  e)  such  that 

Ja  <f>(t)dt  =  e  =  jf  <f>(t)dt,  (23) 

where 


a  —  xu  b  —  X(u+£)  —  xu  +  5i(u,e),  (24) 

c=x(u+\)  d  =  x(tt+i+£)  =«(«+!)  +  ^2(«,e).  (25) 

But  for  u  €  (0,  |),  the  normal  distribution  function  <f>(x)  for  xu  <  x  <  xu  +  ^(u,e)  is 
everywhere  less  than  <f>(x)  for  x(u+^  <x<  x(u+i}  +  S2{u,e)  as  illustrated  in  Figure  3.’ 


Figure  3.  Distance  Between  Modulation  Points,  u  =  - 

According  to  the  Mean- Value  Theorem  [13]:  If  a  function  f(x)  is  continuous  on  a  closed 
interval  [a,  6],  then  there  exists  a  number  x',  a  <  x'  <  b,  for  which 

ja  fix)dx  =  f{x')(b  -  a).  (26) 


Application  of  the  Mean  Value  Theorem  to  each  of  the  integrals  in  (23)  yields 


<t>{x')(b  -  a)  =  <t>[x")(d  -  c). 


(27) 
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But  0  <  4>(x')  <  <f>(x")-  therefore,  b  —  a  >  d  —  c.  Substituting  and  rearranging  the 
inequality,  we  obtain 


Xu  X(«+j)  <  *(«+<)  ~  x(«+|+£)5 


(28) 


or  alternatively,  from  (21) 

*_1(«)  -  $_1(p(u))  <  $_1(u  +  e)  -  $-1(0(u  +  t)). 

(29) 

However,  u  €  (0,  |)  is  arbitrary  and  e  >  0  is  arbitrarily  small;  this  assures  that  $-1(u)  — 
^-1(5(u))  —  although  negative  —  is  strictly  monotonically  increasing  on  the  interval  (0,  |). 

The  subinterval  boundary  point,  u  =  \,  requires  special  attention. 
g(u)  =  |  and 

For  this  value  of  u, 

$-1(u)  —  $-1(<?(u))  =  Xi  —  Xi. 

4  4 

(30) 

For  the  symmetric  Gaussian  distribution  the  relation 

xa  =  -2l -a,  0  <  a  <  1 

(31) 

holds,  and  hence 

$_1(u)  —  $-1(#(u))  =  2xi . 

4 

(32) 

Up  to  now,  our  assumption  has  been  that  x  ~  A7(0,  a2):  to  transform  to  the  standard 
normal  variate  we  evaluate  (x  —  \x)jo  —  z  ~  iV(0, 1)  to  obtain 

xi  =  a  *  zi  =  (—0.675 )<t.  (33) 


A  plot  of  the  signed  difference  is  shown  in  Figure  4  for  noise  power  a2  =  1.  An  entirely 
analogous  argument  to  that  detailed  for  the  subinterval  (0,  |)  holds  for  the  remaining  subin¬ 
tervals  (j,  |),  (|,  |),  and  (|,  1).  As  can  be  seen,  local  minima  for  the  difference  D  occur  at 
u  =  |  and  u  =  |  where  cL;>,  =  1.35a. 


4.1.4  Results  for  Gaussian  Distribution 

In  this  section,  we  determine  the  specific  properties  that  an  optimal  solution  f“  in  ex¬ 
pression  (5)  must  possess. 

If  X  is  a  continuous  random  variable  with  distribution  fx(x),  and  Y  =  g(X)  is  an 
invertible  function  of  AT,  the  well-known  result  [8]: 

My)  =  (34) 

provides  the  distribution  of  the  variable  Y.  In  our  investigation,  X  U(0, 1)  and  Y  =  g( X) 
is  defined  in  (11). 
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Figure  4.  PLNM  Signed  Distance,  D  for  <r2  =  1 


Consider  fx(g  1(y))  in  (34);  g  1(y) :  [0, 1]  — >  [0, 1]  is  one-to-one  and  onto.  This  requires 
that  fxig^iy))  =  1  for  0  <  y  <  1.  Now  consider  ■^g~1(y),  where 


.“I 


0  <  y  <  \ 
|  <  3/  <  1- 


(35) 


The  inverse  g  1  (y)  has  a  discontinuity  at  y  =  so  the  derivative  j^g~l(y)  does  not  exist 
at  that  point;  however,  ^g~\y)  =  1  for  0  <  y  <  1  and  y  ±  i.  Therefore,  from  equation 
(34),  fy{y)  =  1  for  0  <  y  <  1  and  y£\. 

In  other  words,  the  random  variable  Y  is  distributed  uniformly  on  the  unit  interval  [0, 1] 
except  for  a  set  of  measure  zero  (at  y  =  §).  Moreover,  any  transformation  of  the  uniform 
random  variable  X ,  Y  =  g(X)  must  be  of  the  form  Y  =  X  +  c,  where  c  is  a  constant,  if  the 
constraint  that  Y  ~  17(0, 1)  is  to  be  satisfied. 

The  result  that  Y  ~  17(0,1)  was  already  established  in  section  (4.1.1),  where  we  em¬ 
ployed  the  moment  generating  function  to  arrive  at  the  same  conclusion.  However,  at  this 
juncture,  we  have  gone  beyond  section  (4.1.1)  in  two  important  respects.  The  point  of  dis¬ 
continuity,  2/  =  p  ’  ^as  been  identified  as  requiring  special  attention;  and,  we  now  know  that 
the  transformation  g(-)  in  expression  (6)  must  be  of  the  form  Y  =  X  -f  c  when  f(-)  =  f(-). 

To  accommodate  the  discontinuity  at  y  =  I,  it  is  sufficient  to  say  that  Y  ~  77(0, 1)  except 
on  a  set  of  measure  zero.  The  important  point  in  application  is  that  the  discontinuity  has 
no  impact  on  the  PLNM  procedure.  As  a  matter  of  fact,  a  finite  number  of  discontinuities 
will  still  hold  probability  measure  zero. 


4.1.5  Unifying  Result 


What  remains  to  be  established  is  that  (9)  gives  rise  to  an  optimal  solution  to  the 
fundamental  problem  expressed  in  (5)-(6);  i.e.,  we  need  to  show  that  a  solution  to: 


max  min  |u  -  o(u)| , 


(36) 
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is  sufficient  to  assure  that 


max  min  $  1(u)  —  $  1(o(u)) 


is  also  satisfied.  We  will  address  this  problem  with  the  aid  of  the  following  theorem. 
Theorem:  Let  g(u )  be  a  piecewise  linear  bijection  of  the  unit  interval  of  the  form 

{u  +  c  0  <  u  < 1  —  c 

u  —  (1  —  c)  1  —  c  <  u  <  1 
0  otherwise 

where  c  is  a  constant,  0  <  c  <  1.  Then,  the 

min  -*-'(s(«))| 

will  occur  for  a  value  of  u  satisfying  4>(xu)  =  <f>{xg(u)). 

Proof  by  contradiction:  Assume  that  the 

min  |$-1(u)  —  $-1(<7(u))| 

will  occur  for  a  value  of  u  for  which  <t>{xu)  ^  4>{xg(u))-  Let  u  =  u*  be  such  a  value. 

Case  1.  <j>{xu*)  <  4>(xg(u.)). 

If  0  <  u*  <  1  —  c,  then  u*  <  g(u*)  =£>  xu *  <  xg(u*y  Choose  an  epsilon 

0  <  e<  [^(^(u*)) 

Since  4>(x)  is  continuous,  we  have  by  definition 

\<t>(xu)  —  <^(xu.)|  <  e  whenever  \xu  —  xu>  \  <  £i(e) 


|^(xu)  -  <^(a:a(„.))|  <  e  whenever  |x„  -  <  S2(e).  (43) 

Choose  S  —  min(^i,^2)-  Within  a  ^-neighborhood  of  xu»  and  x3(u*),  the  corresponding 
ordinates  <f>(x)  do  not  overlap  (reference  Figure  5).  Now,  increment  u*  by  an  amount  g:  u“  -f 
g  =  u',  such  that  xu>  €  (xu*  —  8,  xu.  -f  d)  and  xg (u/)  €  (xg(u’)  ~  d, xg(u .)  +  d).  (Our  choice  of  e 
and  8  guarantees  that  such  an  7/- value  exists.) 


The  relation 


must  hold. 


f  4>{x)dx  =  g  =  f  9(u  )  <f>(x)da 


From  the  mean  value  theorem  we  have 


( xu '  Xu*}<t>(x  )  —  (xg(u')  Xgiu*))^^  )) 
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- es - - 

u*  X  g(u*) 

Figure  5.  Illustration  of  Case  1 


with 

<&*')  <  (46) 

This  implies  xu,  -  xu.  >  xg(u>)  -  Rearranging,  *,(..)  -  xu.  >  xg{u>)  -  xu>.  This  means 

that  u*  €  (0, 1  —  c)  cannot  be  optimal. 

Consider  now  the  complementary  interval,  (1  —  c,  1). 

^  ~  ct<  u  <  ^  t^ien  9(u*)  <  xg(u*)  <  and  an  appropriate  graphic  would  be 
the  mirror  image  of  Figure  5. 

The  e,  6 ,  argument  remains  unchanged.  Whereas  before  we  considered  an  incremental 
value  of  iT,  we  now  consider  a  decremental  value  of  u*;  u*  -  rj  =  u',  leading  to 


Jfxg(u*)  f&u* 

f  <t>{x)dx  =  71  =  / 

**(«') 


(47) 


and  inequality  xj(u.)-xa(„0  <  xu.-xu,.  Rearranging,  This  means 

that  u*  €  (1  -  c,l)  cannot  be  optimal.  Case  1,  <j>(xu.)  <  <t>{xg(u*)),  cannot  hold. 

Case  2.  <f>(xu.)  >  <t>{xg(u.)). 

Reverting  to  case  1:  4>(xu.)  >  <f>(xg(u* j),  and  u*  on  the  intervals  (0, 1  -  c),  (1  -  c,  1),  an 
argument  identical  to  that  detailed  above  leads  to  the  conclusion  that  4>(xu»)  >  <f>(xg(u.}) 

cannot  hold.  The  proof  is  thus  established  by  contradiction.  ■ 


Determination  of 


(48) 


is  now  straightforward;  <f>(xu)  =  <t>(xg(u))  is  satisfied  when  u  =  1  -  g(u),  with  g(u)  as  given 
in  (38). 

Solving  for  u,  we  obtain  the  values 

1  c 

u  =  -(1  —  c)  and  u  =  1 - 

2  2 

for  which  |$  1(u)  —  $  1(^(u))|  must  be  evaluated  to  determine  local  extrema. 

The  minimum  value  may  be  expressed  for  0  <  c  <  |  as 


(49) 


(50) 
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This  value  is  monotone  increasing  over  the  specified  interval.  Over  the  entire  interval, 
0  <  c  <  1,  (50)  is  symmetric  about  c  =  1/2,  at  which  the  global  maximum  is  assumed.  The 
entire  function  is  graphed  in  Figure  6  for  <7  =  1. 


Figure  6.  Minimum  Distance  vs.  Discontinuity  Location 


5.  Comparison  of  Noise  Modulation  Techniques 

Both  PLNM,  presented  in  Section  4,  and  antipodal  noise  modulation,  Section  3,  modulate 
a  binary  input  signal  and  produce  Gaussian  noise,  regardless  of  the  distribution  of  that 
input  signal.  We  established  that  PLNM  has  greater  noise  immunity  than  the  antipodal 
modulation  by  comparing  the  minimum  Euclidean  distance  between  modulation  points,  dm2n, 
for  each  technique.  Recall,  in  the  presence  of  noise,  a  transmitted  signal  can  be  correctly 
detected  if  the  distortion  does  not  exceed  a  threshold  value  of  dmin/2  [14].  For  antipodal 
noise  modulation  this  threshold  is  equal  to  0,  but  for  PLNM,  dminj 2  =  1.35<j/2  and  a2  can 
be  adjusted  to  achieve  the  desired  performance. 

Traditionally,  when  detecting  signals  in  the  presence  of  AWGN,  modulation  techniques 
are  compared  by  computing  a  probability  of  error,  Pe.  Let  us  assume  a  maximum  a  posteriori 
(MAP)  detector  with  the  binary  information  bits  having  equal  probability  of  occurrence. 
Then,  the  probability  of  error  can  be  computed  using  the  distance  between  the  modulation 
points  and  the  power  of  the  channel  AWGN. 

We  begin  with  the  familiar  case  of  uncoded  antipodal  (binary)  modulation  and  use  a 
traditional  modulation  technique  by  which  to  compare  our  two  noise  modulation  methods. 
For  all  methods,  let  us  denote  a  modulated  signal  as  s  and  the  channel  AWGN  as  the  signal 
v  with  power  cr2.  Then,  the  probability  of  error  for  uncoded  antipodal  modulation  with 
modulation  values  of  s  =  m  €  {±1}  is 
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where  Q  represents  the  complementary  error  function,  A  is  equal  to  the  distance  between 
the  modulation  signals,  |s(m,  =  -1)  -  s(m;  =  1)|,  and  cr2  =  N0/2  [14]. 

The  noise  modulation  techniques  considered  in  this  paper  produce  Gaussian  noise.  There¬ 
fore,  the  probability  of  error  is  conditional  upon  the  value  of  a  random  variable.  Con¬ 
sequently,  the  conditional  probability  of  error  for  the  antipodal  noise  modulation  can  be 
expressed  as 


with  n  ~  For  PLNM,  the  conditional  probability  of  error  is 

*  4 1  27,  )  ’  <53) 

where  u  U(  0, 1). 

To  present  the  probability  of  error  for  antipodal  noise  modulation  and  PLNM  as  a  func¬ 
tion  of  the  signal-to-noise  ratio  (SNR),  we  compute  the  expected  probability  of  error  by 
weighting  the  conditional  probability  of  error  with  the  probability  distribution  of  the  ran- 
dom  variables  n  and  u,  respectively. 

The  two  noise  modulation  techniques  are  compared  in  Figure  7,  where  the  expected  Pe 
in  relation  to  SNR  is  shown.  In  addition,  the  Pe-SNR  performance  of  uncoded  antipodal 

modulation  has  been  included  to  demonstrate  the  relation  of  noise  modulation  to  uncoded 
modulation. 

As  is  demonstrated  in  Figure  7,  the  antipodal  noise  modulation  experiences  a  floor  ef¬ 
fect  with  the  expected  Pe  not  less  than  10"2  at  30  dB  SNR.  The  PLNM  has  much  better 
performance  than  the  antipodal  noise  modulation  and  is  similar  to  that  of  uncoded  binary 
modulation.  Of  course,  the  uncoded  antipodal  modulation  has  better  Pe  performance  than 
PLNM  because  the  uncoded  signal  is  not  constrained  to  follow  a  Gaussian  distribution  (hid¬ 
den  m  noise).  The  performance  difference  between  uncoded  modulation  and  PLNM  can  be 
attributed  to  hiding  the  transmitted  data  in  a  Gaussian  noise.  This  hiding  exhibits  a  2.36 
dB  loss  in  SNR  at  a  Pe  equal  to  10-1°. 


6.  Conclusions 


In  this  paper,  we  presented  a  modulation  technique  to  embed  a  binary  bitstream  within  a 
real- valued  Gaussian  noise  sequence  that  possesses  a  minimum  distance  property  to  promote 
accurate  detection.  The  resultant  signal  is  Gaussian  in  nature  and  is  difficult  to  intercept 
due  to  its  low  power.  The  technique  can  be  used  to  hide  information  within  a  noise  sequence 
that  is  then  added  to  a  carrier  for  a  variety  of  applications.  In  addition,  we  established 
that  the  PLNM  modulation  function  is  an  optimal  mapping  that  maximizes  the  minimum 
distance  between  modulation  points  while  meeting  the  desired  stochastic  constraint. 
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0 


Figure  7.  Comparison  of  Modulation  Techniques 


There  are  some  extensions  of  this  work  that  were  deemed  to  be  beyond  the  scope  of 
this  paper.  The  effect  of  more  than  one  discontinuity  on  the  value  of  dmtn  in  the  PLNM 
procedure  was  not  investigated.  Additionally,  it  may  be  possible  to  follow  the  PLNM  frame¬ 
work  established  here  to  embed  information  within  non-Gaussain  noise  sequences  that  hold 
importance  in  application. 
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